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1. DETAILED ACTION 

2. Oath/Declaration 

3. The applicant's oath/declaration has been reviewed by the examiner and is found 
to conform to the requirements prescribed in 37 C.F.R. 1.63. 

4. Priority 

5. Acknowledgment is made of applicant's claim for foreign priority under 35 
U.S.C. 119(a)-(d). The certified copy has been filed in parent Application No. 10-2003- 
0079865, filed on 12 November 2003 and PCT/KR03/02917 filed 30 December 2003. 

6. Information Disclosure Statement 

7. As required by M.P.E.P. 609(C), the applicant's submissions of the Information 
Disclosure Statements dated 01/05/2009, 01/05/2009, and 05/12/2006 are 
acknowledged by the examiner and the cited references have been considered in the 
examination of the claims now pending. As required by M.P.E.P. 609 C(2), a copy of the 
PTOL-1449 initialed and dated by the examiner is attached to the instant office action. 

8. Specification 

9. The disclosure is objected to because of the following informalities: the title 
contains grammatical errors, "synchronized the five senses" should be "the 
synchronized five senses". 
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1 1. Allowable Subject Matter 

12. Claim 6, 9 objected to as being dependent upon a rejected base claim, but would 
be allowable if rewritten in independent form including all of the limitations of the base 
claim and any intervening claims. 

13. Claim Rejections - 35 USC § 103 

14. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

1 5. A patent may not be obtained though the invention is not identically disclosed or described as set forth 
in section 102 of this title, if the differences between the subject matter sought to be patented and the prior art 
are such that the subject matter as a whole would have been obvious at the time the invention was made to a 
person having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived 
by the manner in which the invention was made. 

16. Claim 1, 7, 10, 15 rejected under 35 U.S.C. 103(a) as being unpatentable 
over Konrad (US-5974444), and further in view of Shibata (US-5402418), Tremblay 
(US-6275213), Wittek (US-5963302), Rowan (US-5341229), Serbanescu (US- 
20030162595), Ro (US-20020150123). 

17. As to claim 1,7, 10, 15: Konrad teaches a system for providing actual-feeling 
multimedia data, comprising: a video/audio data generating means for generating 
video/audio data by receiving multimedia data from an external device (fig.3c; col.9, 
ln.13-59; col.13, ln.44-50; col.21, ln.1-44 ESP col.9, ln.33-35, 50-52: visual display 
and audio output); a touch data describing means for describing ... expressed in the 
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multimedia data transmitted from the external device based on a predefined touch data 
descriptor (fig.3c; col.9, ln.13-59; col.13, ln.44-50; col.21, ln.1-44 ESP col.9, ln.37- 
38, 52-53: tactile output devices; wherein data descriptors necessary in order to 
output something); an odor data describing means for describing an odor expressed in 
the multimedia data received from the external device based on a predefined odor data 
descriptor (fig.3c; col.9, ln.13-59; col.13, ln.44-50; col.21, ln.1-44 ESP col.9, ln.36, 
57: olfactory output devices; wherein data descriptors necessary in order to 
output something); a taste data describing means for describing a taste expressed in 
the multimedia data received from the external device based on a predefined taste data 
descriptor (fig.3c; col.9, ln.13-59; col.13, ln.44-50; col.21, ln.1-44 ESP col.9, ln.36, 
57: gustatory output devices; wherein data descriptors necessary in order to 
output something); a video/audio packet forming means for forming video/audio 
packets out of the video/audio data generated in the video/audio generating means 
(fig.3c, 108; col.8, ln.65-col.9, ln.8: audio and video data must be packetized in 
order to be transported over the network from the remote host to the local host); 
a touch/odor/taste packet forming means for forming a touch packet, an odor packet, 
and a taste packet out of the touch, odor and taste data described in the touch data 
describing means, the odor data describing means, and the taste data describing 
means, respectively (fig.3c, 108; col.8, ln.65-col.9, ln.8: touch, odor, and taste data 
must be packetized in order to be transported over the network from the remote 
host to the local host); a multiplexing means for multiplexing the video/audio packets 
generated in the video/audio packet generating means and the touch packet, the odor 
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packet and the taste packet formed in the touch/odor/taste packet forming means to 
thereby ... the video/audio packets with the touch/odor/taste packets (fig.3c; col.7, 
In. 16-19, 39-45; col. 10, In. 12-18: a server performs multiplexing and de- 
multiplexing of data); a transmitting means for transmitting a multiplexed packet 
obtained in the multiplexing means (fig.3c; col.7, In. 16-19, 39-45; col. 10, In. 12-18: a 
server performs multiplexing and de-multiplexing of data and transmits and 
receives data); a receiving means for receiving the multiplexed packet (fig.3c; col.7, 
In. 16-19, 39-45; col. 10, In. 12-18: a server performs multiplexing and de- 
multiplexing of data and transmits and receives data); a demultiplexing means for 
demultiplexing the multiplexed packet received by the receiving means into the video 
data, the audio data, the touch data, the odor data and the taste data (fig.3c; col.7, 
In. 16-19, 39-45; col. 10, In. 12-18: a server performs multiplexing and de- 
multiplexing of data). 

18. Konrad may not explicitly teach synchronize the video/audio packets with the 
touch/odor/taste packets. However, Serbanescu teaches synchronizing various output 
media, such as taste, odor, touch along with audio and video to have a rich, interactive 
multimedia experienced having all the senses engaged ([0005], [0008], [0030], [0059- 
0061]). Serabanescu may not explicitly teach that the packets themselves are 
synchronized. However, it is common knowledge in the art that synchronization of 
packets is a technique for having output media match-up for presentation. This is 
illustrated by Ro who teaches audio and video packets synchronized together in order 
to present the audio and video together (Ro; [0045], [0055], [0064]). 
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1 9. Thus, it would have been obvious to one of ordinary skill in the art to implement 
the teachings of Serabanescu into Konrad since Konrad teaches a human interface 
service outputting audio, video, taste, smell, and touch information to a user (col.9, 

In. 13-59; col. 13, ln.44-50; col.21, In. 1-44) and Serabanescu suggests synchronization 
between audio, video, taste, smell, and touch in order to present an interactive media 
experience engaging all of the senses synchronously ([0005], [0008], [0030], [0059- 
0061]). 

20. Also, it would have been obvious to one of ordinary skill in the art at the time of 
the invention to synchronize the audio and video packets with the taste, smell, and 
touch packets because it is already common knowledge in the art to synchronize audio 
and video packets in order to display audio and video together at the correct time as to 
avoid a disjoint presentation (Ro; [0045], [0055], [0064]). It would have been obvious 
to synchronize taste, smell, and touch packets to present them together for an 
interactive media experience and avoid a disjoint presentation. 

21. Konrad may not explicitly teach a video device for decoding and outputting the 
video data demultiplexed by the demultiplexing means; an audio device for decoding 
and outputting the audio data demultiplexed by the demultiplexing means. 

22. Shibata teaches a video device for decoding and outputting the video 

data demultiplexed by the demultiplexing means (col.3, ln.58 - col.4, In. 12: audio and 
video decoder and de-multiplexer for output); an audio device for decoding and 
outputting the audio data demultiplexed by the demultiplexing means (col.3, ln.58 - 
col.4, In. 12: audio and video decoder and de-multiplexer for output). 
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23. Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to implement the teachings of Shibata into Konrad since Konrad 
suggests a human interface service that receives and outputs audio and video data 
(fig.3c; col.9, ln.13-59; col.13, ln.44-50; col.21, ln.1-44 ESP col.9, ln.33-35, 50-52: 
visual display and audio output) in general and Shibata suggests decoding and de- 
multiplexing audio and video data, the motivation being to play audio and display video 
for a video conference call (col.3, In. 58 - col.4, In. 12). 

24. Konrad may not explicitly teach a vibration device for providing vibration to a user 
by interpreting the touch data demultiplexed by the demultiplexing means. 

25. Tremblay teaches a vibration device for providing vibration to a user by 
interpreting the touch data demultiplexed by the demultiplexing means (col.1, In. 15-39; 
col.2, In. 14-33: vibration from tactile information). 

26. Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to implement the teachings of Tremblay into Konrad since Konrad 
suggests a human interface service receiving and demultiplexing tactile data and 
outputting through a tactile output device (col.9, ln.29-59) in general and Tremblay 
suggests a tactile output device producing vibrations, the motivation being to provide a 
virtual reality experience for the user (col.1, In. 15-39, 40-52; col.2, In. 14-33). 

27. Konrad may not explicitly teach an odor device for spraying chemical aromatics 
to a user by interpreting the odor data demultiplexed by the demultiplexing means. 
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28. Wittek teaches an odor device for spraying chemical aromatics to a user by 
interpreting the odor data demultiplexed by the demultiplexing means; and (col.2, ln.50- 
65; col.3, ln.33-45: scent control signal for spaying chemical aromas). 

29. Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to implement the teachings of Wittek into Konrad since Konrad 
suggests a human interface service receiving and demultiplexing olfactory data and 
outputting through an olfactory output device (col.9, ln.57) in general and Wittek 
suggests a olfactory output device producing chemical aromatics, the motivation being 
to intensify visual and acoustic reception (col.1, ln.22-25). 

30. Konrad may not explicitly teach a taste device for releasing a taste forming 
material to a user by interpreting the taste data demultiplexed by the demultiplexing 
means. 

31 . Rowan teaches a taste device for releasing a taste forming material to a user by 
interpreting the taste data demultiplexed by the demultiplexing means (col.1, In. 14-33: 
chemical release mechanism for taste in order to enhance audio or visual 
stimuli). 

32. Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to implement the teachings of Rowan into Konrad since Konrad 
suggests a human interface service receiving gustatory data and outputting through a 
gustatory output device (col.9, ln.39-40) in general and Rowan suggests a gustatory 
output device releasing chemicals for taste, the motivation being to enhance audio and 
visual stimuli (col.1, In. 14-33). 
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33. Claim 5 rejected under 35 U.S.C. 103(a) as being unpatentable over Konrad 
(US-5974444), Shibata (US-5402418), Tremblay (US-6275213), Wittek (US-5963302), 
Rowan (US-5341229), Serbanescu (US-200301 62595), Ro (US-20020150123) as 
applied to claim 1 above, and further in view of Wan (US-20020054608). 

34. As to claim 5: Konrad teaches the apparatus as recited in claim 1 , wherein the 
touch/odor/taste packet forming means forms a touch packet including information on 
whether the touch data are described, ... , and information on the touch data descriptors 
described in the touch data describing means (fig. 3c; col.9, In. 13-59; col. 13, ln.44-50; 
col. 21, In. 1-44: information packets describing touch); an odor packet including 
information on whether odor data are described, ... , and information on the odor data 
descriptors described in the odor data describing means (fig.3c; col.9, In. 13-59; col. 13, 
ln.44-50; col.21, In. 1-44: information packets describing odor); and a taste packet 
including information on whether taste data are described, ... , and information on the 
taste data descriptors described in the taste data describing means (fig.3c; col.9, In. 13- 
59; col. 13, ln.44-50; col.21, In. 1-44: information packets describing taste). 

35. Konrad may not explicitly teach information on touch packet length ... information 
on an odor packet length ... information on a taste packet length. 

36. However, information describing the length of a packet is commonly known in the 
art. This is illustrated by Wan where a video / audio packet includes information with 
regards to packet length ([0014]). Thus, it would have been obvious to one of ordinary 
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skill in the art at the time of the invention to implement packet lengths in odor, taste, and 
touch packets in order to know their start and ending point of the packets and to 
accurately process them. 

37. Claim 2, 3, 4, 8 rejected under 35 U.S.C. 103(a) as being unpatentable over 
Konrad (US-5974444), Shibata (US-5402418), Tremblay (US-6275213), Wittek (US- 
5963302), Rowan (US-5341229), Serbanescu (US-200301 62595), Ro (US- 
20020150123) as applied to claim 1, 7 above, and further in view of Roy (US- 
20010036868), DiNunzio (US-6007338). 

38. As to claim 2, 3, 4, 8: Konrad teaches the method as recited in claim 1 , 7. 

39. Konrad may not explicitly teach wherein in the step b), the vibration expressed in 
the multimedia data transmitted from the external device is described based on a 
descriptor describing whether touch data are described; A descriptor describing whether 
right/left movement is described; a descriptor describing whether up/down movement is 
described; a descriptor describing whether back/forth movement is described. 

40. Roy teaches wherein in the step b), the vibration expressed in the multimedia 
data transmitted from the external device is described based on a descriptor describing 
whether touch data are described; A descriptor describing whether right/left movement 
is described ([0014], [0056]; claim 16: axial displacement for tilt); a descriptor 
describing whether up/down movement is described ([0048], [0051-0052], [0056]: raise 
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and lower vertically); a descriptor describing whether back/forth movement is 
described ([0014], [0056]; claim 16: axial displacement for tilt). 

41 . Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to implement the teachings of Roy into Konrad since Konrad 
suggests a human interface service where tactile data having descriptors is conveyed 
over a network and output through a tactile output device such as a pressure suit (col.9, 
ln.53-54) in general and Roy suggests a tactile output device having axial displacement 
for front / back, left / right tilt and a vertical up / down motion controlled by control 
signals, the motivation being to enhance an audiovisual experience, such as gaming or 
movies, with motion transducers ([0009-0011]). 

42. Konrad, Roy may not explicitly teach a descriptor describing a distance of 
movement; a descriptor describing a speed of movement; a descriptor describing an 
acceleration of movement. 

43. However, Roy teaches control values for the actuators and the possibility of 
precisely controlling the mechanical movements transmitted to the chair adapter 
([0014], [0056]). It would have been obvious to one of skill in the art at the time of the 
invention to precisely control the motion transducers with regards to distance, speed, 
and acceleration in order to customize the vertical and axial motions and not be limited 
to a single setting with regards to distance, speed, and acceleration. This allows the 
motion transducers to be customized to a plethora of situations, from the quick vibrating 
hum of aircraft to the slow rolling waves of the ocean rather than being confined to a 
single setting. 
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44. Konrad, Roy may not explicitly teach a descriptor describing whether right/left 
rotation is described; a descriptor describing an angle of right/left rotation; a descriptor 
describing a speed of right/left rotation; a descriptor describing an acceleration of 
right/left rotation. 

45. DiNunzio teaches a descriptor describing whether right/left rotation is described 
(fig.4a, 4b; col.8, ln.48-67: yaw rotation around the z-axis); a descriptor describing 
an angle of right/left rotation (fig.4a, 4b; col.8, ln.48-67: yaw rotation around the z- 
axis has degree of motion less than 90 degrees + / -). 

46. Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to implement the teachings of DiNunzio into Roy since Roy 
suggests a tactile output device having axial displacement for front / back, left / right tilt 
and a vertical up / down motion with motion transducers controlled by control signals 
([0009-0011]) in general and DiNunzio suggests a tactile output device having yaw, roll 
and pitch motions synchronized with audio and video the motivation being to provide for 
greater degrees of freedom and offer more motions with which to enhance an 
audiovisual experience (fig.4a, 4b; col.8, ln.39-67; claim 2). 

47. Konrad, DiNunzio may not explicitly teach a descriptor describing a speed of 
right/left rotation; a descriptor describing an acceleration of right/left rotation. 

48. However, DiNunzio teaches controlling the speed of the overall experience, 
make-up of the roller coaster track, and simulates the acceleration experienced by the 
user(col.5, In. 1-8; col.6, In. 1-14; col.9, In. 1-23). In order to simulate speed and 
acceleration around the roller coaster track, acceleration and speed control signals / 
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descriptors for the motion transducers are necessary. It would have been obvious to 
one of ordinary skill in the art to implement speed and acceleration descriptors in 
DiNunzio in order to make feasible the custom design of roller coaster elements with 
loops and corkscrews of varying diameter and intensity and provide a varied experience 
as opposed to having the exact same speed and acceleration throughout the entire 
simulation. 

49. Konrad, Roy, DiNunzio may not explicitly teach the odor expressed in the 
multimedia data received from the external device is described based on a descriptor 
describing whether the odor data are described; a descriptor describing a kind of the 
odor; and a descriptor describing an intensity of the odor. 

50. Wittek teaches the odor expressed in the multimedia data received from the 
external device is described based on a descriptor describing whether the odor data are 
described; a descriptor describing a kind of the odor; and a descriptor describing an 
intensity of the odor (col.3, ln.32-45: control signals indicating the type and 
intensity of the scent). 

51. Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to implement the teachings of Wittek into Konrad since Konrad 
suggests a human interface service multiplexing olfactory data having descriptors and 
output through an olfactory I/O device (col.9, ln.57) in general and Wittek suggests 
scent release mechanisms synchronized with audiovisual affects where control signals 
control the type and intensity of the scent, the motivation being to intensify and enrich 
the audiovisual experience (col.1, ln.22-25). 
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52. Konrad, Roy, DiNunzio, Wittek may not explicitly teach and, the taste expressed 
in the multimedia data received from the external device is described based on a 
descriptor describing whether the taste data are described; a descriptor describing a 
kind of the taste; and a descriptor describing an intensity of the taste. 

53. However, Konrad teaches a human interface service receiving multiplexed 
gustatory signals over a network for output to a gustatory I/O device (col.9, ln.57). 
Wittek teaches control signals for controlling the type and intensity of the scent (col.3, 
ln.32-45). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to use control signals similar to those of Wittek and apply them to the 
gustatory output of Konrad, the motivation being to intensify and enrich the audiovisual 
experience with taste sensations and to be able to customize the taste sensations to 
different audiovisual situations presented (Wittek, col.1, ln.22-25). 

54. Claim 11 rejected under 35 U.S.C. 103(a) as being unpatentable over 
Konrad (US-5974444), Shibata (US-5402418), Tremblay (US-6275213), Wittek (US- 
5963302), Rowan (US-5341229), Serbanescu (US-200301 62595), Ro (US- 
20020150123) as applied to claim 10 above, and further in view of Farmer (US- 
5907366). 

55. As to claim 1 1 : Konrad teaches the system as recited in claim 10. 

56. Konrad may not explicitly teach wherein the demultiplexing means deletes 
network-related information from the received packet in form of a compressed stream 
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by depacketizing divides the depacketized packet into the video data, the audio data ... 
on a basis of a multimedia data frame, and transmits the video data, the audio data ... 
to corresponding devices based on header information. 

57. Farmer teaches wherein the demultiplexing means deletes network-related 
information from the received packet in form of a compressed stream by depacketizing 
(col.9, In. 15-40: transport de-multiplexer separates signal and removes transport 
header information) divides the depacketized packet into the video data, the audio 
data (col.9, In. 15-40: transport de-multiplexer separates signal into audio and 
video data), ... on a basis of a multimedia data frame (col.9, In. 15-40: MPEG frame), 
and transmits the video data, the audio data (col.9, In. 15-40: audio / video payload 
routed to storage), ... to corresponding devices based on header information (col.9, 
In. 15-40: header information indicates type of payload). 

58. Farmer may not explicitly teach divides the depacketized packet into ... the touch 
data, the odor data and the taste data on a basis of a multimedia data frame, and 
transmits the ... touch data, the odor data and the taste data to corresponding devices 
based on header information. 

59. However, Konrad teaches the multiplexing and de-multiplexing of audio, video, 
touch, smell, and taste information (fig.3c; col.9, In. 13-59; col. 13, ln.44-50; col.21, 

In. 1-44) and Farmer teaches all in the above paragraph with regards to audio and video 
packets. It would have been obvious to one of ordinary skill in the art at the time of the 
invention to combine Farmer and Konrad and implement the de-multiplexing, de- 
packetization and transmission of touch, odor, and taste data based on the header in 
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order to separate the different payloads and process them with the appropriate output 
devices and create an interactive multimedia experience involving all of the senses. 

60. Claim 12, 13, 14 rejected under 35 U.S.C. 103(a) as being unpatentable over 
Konrad (US-5974444), Shibata (US-5402418), Tremblay (US-6275213), Wittek (US- 
5963302), Rowan (US-5341229), Serbanescu (US-200301 62595), Ro (US- 
20020150123) as applied to claim 10 above, and further in view of Roy (US- 
20010036868). 

61 . As to claim 12: Konrad teaches the system as recited in claim 10, ... which are 
demultiplexed in the demultiplexing means (fig. 3c; col.7, In. 16-19, 39-45; col. 10, In. 12- 
18: a server performs multiplexing and de-multiplexing of data), based on a 
predefined touch data descriptor (col.9, ln.80: tactile output devices; wherein touch 
data descriptors necessary for proper functionality). 

62. Konrad may not explicitly teach wherein the vibration device moves to right and 
left, back and forth, and up and down or rotates by interpreting the touch data, ... and a 
starting time and a duration time of movement or rotation operation. 

63. Roy teaches wherein the vibration device moves to right and left, back and forth 
([0014], [0056]; claim 16: axial displacement for tilt), and up and down or rotates by 
interpreting the touch data ([0048], [0051-0052], [0056]: raise and lower vertically), . .. 
and a starting time and a duration time of movement or rotation operation ([0042]: start 
and duration time for transducer action). 
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64. Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to implement the teachings of Roy into Konrad since Konrad 
suggests a human interface service where tactile data having descriptors is conveyed 
over a network and output through a tactile output device such as a pressure suit (col.9, 
ln.53-54) in general and Roy suggests a tactile output device having axial displacement 
for front / back, left / right tilt and a vertical up / down motion controlled by control 
signals, the motivation being to enhance an audiovisual experience, such as gaming or 
movies, with motion transducers ([0009-0011]). 

65. Konrad, Roy may not explicitly teach are synchronized with a moving picture and 
a sound outputted from the video device and the audio device, respectively ([0005], 
[0008], [0030], [0059-0061]). However, Serbanescu teaches synchronizing various 
output media, such as taste, odor, touch along with audio and video ([0005], [0008], 
[0030], [0059-0061]). Serabanescu may not explicitly teach that the packets 
themselves are synchronized. However, it is common knowledge in the art that 
synchronization of packets is a technique for having output media match-up for 
presentation. This is illustrated by Ro who teaches audio and video packets 
synchronized together in order to present the audio and video together (Ro; [0045], 
[0055], [0064]). 

66. Thus, it would have been obvious to one of ordinary skill in the art to implement 
the teachings of Serabanescu into Konrad since Konrad teaches a human interface 
service outputting audio, video, taste, smell, and touch information to a user (col.9, 

In. 13-59; col. 13, ln.44-50; col.21, In. 1-44) and Serabanescu suggests synchronization 
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between audio, video, taste, smell, and touch in order to present an interactive media 
experience ([0005], [0008], [0030], [0059-0061]). 

67. As to claim 13: Konrad teaches the system as recited in claim 12, ... which are 
demultiplexed in the demultiplexing means (fig.3c; col.7, In. 16-19, 39-45; col. 10, In. 12- 
18: a server performs multiplexing and de-multiplexing of data), based on a 
predetermined odor data descriptor (col.9, ln.57: olfactory output devices; wherein 
olfactory data descriptors necessary for proper functionality). 

68. Konrad may not explicitly teach wherein the odor device sprays the chemical 
aromatics by interpreting the odor data ... and a starting time and a duration time of 
spraying operation are synchronized with a moving picture and a sound outputted from 
the video device and the audio device, respectively. 

69. Wittek teaches wherein the odor device sprays the chemical aromatics by 
interpreting the odor data (col.2, In. 50-65; col.3, ln.33-45: scent control signal for 
spaying chemical aromas) ... and a starting time and a duration time of spraying 
operation are synchronized with a moving picture and a sound outputted from the video 
device and the audio device, respectively (col. 14, 5-59: scent entrance and duration 
is synchronized with movie). 

70. Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to implement the teachings of Wittek into Konrad since Konrad 
suggests a human interface service multiplexing olfactory data having descriptors and 
output through an olfactory I/O device (col.9, ln.57) in general and Wittek suggests 
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scent release mechanisms synchronized with audiovisual affects where control signals 
control the type and intensity of the scent, the motivation being to intensify and enrich 
the audiovisual experience (col.1, ln.22-25). 

71 . As to claim 14: Konrad teaches the system as recited in claim 13, ... which are 
demultiplexed in the demultiplexing means (fig.3c; col.7, In. 16-19, 39-45; col. 10, In. 12- 
18: a server performs multiplexing and de-multiplexing of data), based on a 
predetermined taste data descriptor (col.9, ln.57: gustatory output devices; wherein 
gustatory data descriptors necessary for proper functionality). 

72. Konrad may not explicitly teach wherein the taste device releases taste forming 
materials by interpreting the taste data, ... and a starting time and a duration time of 
releasing operation are synchronized with a moving picture and a sound outputted from 
the video device and the audio device, respectively. 

73. Rowan teaches wherein the taste device releases taste forming materials by 
interpreting the taste data (col.1, In. 14-33: chemical release mechanism for taste in 
order to enhance audio or visual stimuli), ... and a starting time and a duration time 
of releasing operation are synchronized with a moving picture and a sound outputted 
from the video device and the audio device, respectively (col.1, In. 14-33: chemical 
release mechanism synchronized with audiovisual presentation). 

74. Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to implement the teachings of Rowan into Konrad since Konrad 
suggests a human interface service receiving gustatory data and outputting through a 
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gustatory output device (col.9, ln.39-40) in general and Rowan suggests a gustatory 
output device releasing chemicals for taste, the motivation being to enhance audio and 
visual stimuli (col.1, In. 14-33). 



75. Conclusion 

76. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ANDREW OH whose telephone number is (571)270- 
5273. The examiner can normally be reached on M-F 8:30AM - 5AM EST. 

77. If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Daniel J. Ryman can be reached on (571)272-3152. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

78. Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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